While the contact is removed from the group, the individual entry for the contact remains in your address book.